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Abstract. We study the Levy spin-glass model with the replica and the cavity 
method. In this model each spin interacts through a finite number of strong bonds 
and an infinite number of weak bonds. This hybrid behaviour of Levy spin glasses 
becomes transparent in our solution: the local field contains a part propagating along 
a backbone of strong bonds and a Gaussian noise term due to weak bonds. Our 
method allows to determine the complete replica symmetric phase diagram, the replica 
symmetry breaking line and the entropy. The results are compared with simulations 
and previous calculations using a Gaussian ansatz for the distribution of fields. 



1. Introduction 

The prototype mean-field model of spin glasses is the Sherrington-Kirkpatrick (SK) 
model [HE], [3]. In this fully-connected (FC) system any pair of spins is coupled through 
weak interactions, of order 0(N~ l l 2 ) in the total number of spins N, whose values are 
drawn independently from a Gaussian distribution. 

Within the assumption that the free-energy landscape contains one single valley, 
the effective field on a given spin is a sum of a large number of uncorrelated random 
variables with a finite variance and the usual central limit theorem (CLT) holds. As 
a consequence, the effective field follows a Gaussian distribution fully characterized 
by its first two moments, leading to a description in terms of two observables: the 
magnetization and the Edwards-Anderson order parameter. The CLT reflects the 
independence of the macroscopic behavior of the system with respect to the details 
of the coupling distribution. The existence of a CLT in the SK model is technically very 
convenient and simplifies the replica and the cavity method at high temperatures T. At 
low temperatures extreme values become important and a more complicated description 
is necessary. The success of the cavity and replica method lies in the detailed and exact 
description they give of the intricate behavior of the SK model at low temperatures, 
characterized by the presence of several degenerate states separated by infinite barriers 

However, it was shown that materials composed of magnetic impurities, randomly 
distributed in a non-magnetic host and interacting through the RKKY dipolar potential, 
exhibit a Cauchy distribution of effective fields. This is in particular true for a small 
concentration of magnetic impurities [H [5]. An analogous result was obtained in a 
spatially disordered system of particles with dipolar interactions [6]. These results 
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suggest that the choice of a coupling distribution that allows a wider variation of 
coupling strengths would be more realistic than the traditional Gaussian assumption 
used in mean-field models for spin glasses. 

Disordered systems in which the randomness of the disorder variable J is modelled 
by a distribution P(J) that has a power-law decay P(J) ~ | (a < 2), for large 

|J|, have attracted less interest. A possible reason is the technical challenge to deal 
with distributions that do not fulfill the classical CLT. The heavy tails of P(J) give 
rise to the divergence of the second moment of the distribution, which invalidates the 
application of classical CLT. In this case, the generalized CLT of Levy and Gnedenko 
holds [7J Ej, and the sum of a large number of independent random variables drawn 
from P(J) follows the same distribution as the individual summands, exhibiting only 
different scale factors. The role of the large tails of J has proven to be crucial to the 
long time or large size properties of different disordered systems [9] . As examples in this 
context, we mention the theory of random matrices [TUl [TTl [T2] . diffusion processes [13] 
and the portfolio optimization problem in theoretical finance |14j . 

A FC model of spin glasses with interactions drawn from a distribution with power- 
law tails (a Levy spin glass) was introduced by Cizeau and Bouchaud [15]. In Levy spin 
glasses every spin interacts with infinitely many weak bonds of order O (iV -1 /") and a 
finite number of strong bonds of order O (1). In this sense the model is a hybrid between 
a FC spin glass, like the SK model, and a finitely connected (FiC) spin glass, like the 
Viana-Bray model [IB] . The authors of [15] studied the model with the cavity method 
under the assumption that the distribution of effective fields is Gaussian. They found 
a spin glass phase stable under replica symmetry breaking and it was conjectured that 
at zero temperature the stability of replica symmetry is restored for a < 1. Recently, 
this model has been studied with replica theory [T7J. The effective field distribution is 
not Gaussian. In [17] a complete phase diagram and a discussion of replica symmetry 
breaking was not given. 

The purpose of this paper is to improve upon the foregoing studies by deriving 
the complete phase diagram without the Gaussian assumption, the entropy and the 
stability to replica symmetry breaking effects. We propose a method that consists in 
the insertion of a small cutoff in the distribution of the couplings P(J), which gives rise 
to a natural distinction between "weak bonds" and "strong bonds" . This allows us to 
solve the problem through both the replica method and the cavity method. We obtain 
a solvable self-consistent equation for the distribution of effective fields. Formally this 
equation is similar to the self-consistent equation for the effective field distribution of a 
FiC spin-glass system on a random graph [18] and a straightforward implementation of 
the population dynamics algorithm [19] is possible. Therefore, the procedure allows us to 
obtain the complete phase diagram of the model for all Levy distributions in contrast to 
previous works [T5lfT7]. We include a skewness parameter in the definition of the model, 
responsible for controlling the relative weight between the positive and the negative tails 
of the coupling distribution. The dependence of the different phases on this parameter is 
shown in the phase diagrams. The results are compared with simulations. We calculate 
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the entropy of the system and the stability against replica symmetry breaking. Our 
results are compared with those obtained by Cizeau and Bouchaud [15] . 

The paper is organized as follows. In section [2, we define the model. We explain how 
to solve the model through replica theory in section [3] and through the cavity method in 
section HI In these sections we calculate the distribution of effective fields and compare 
them with the Gaussian assumption on the distribution of those fields. The behavior 
of the magnetization is compared with simulations. In section [5J we derive the stability 
condition against replica symmetry breaking. The order parameter equations, derived 
in sections [3j [4] and [5_1 are solved numerically to obtain the phase diagrams and the 
entropy in sections [6] and [7J In section [8] we present our conclusions. The effect of the 
different parameters of the Levy distributions is shown in appendix A. Some details of 
the replica calculations are given in appendix B. 



2. The Levy spin glass 



We study a FC system of N Ising spins <7j = ±1 (i — 1, . . . , N) with the Hamiltonian 

H = — ^2 JijCi&j, (1) 

where the symmetric couplings {Jij} are i.d.d.r.v. drawn from a stable distribution 
pA.7,Jo(j). W e define the stable distribut ions P Jl ' 7 ' Jo (J) through their characteristic 
function L£' 7 ' J °(g): 

dq 



jJl,7,J 



(J) 



■In 



exp(-igj) pA 7 ' J °(g). 



The characterstic function is of the form 



L J a ^' J °{q) =exp 



~.qJo 




% . N 





ry$sign(g)) 



(2) 



(3) 



The distribution P^ 1 ' 7, °(J) is characterized by four parameters: the exponent a G 
(0, 1) U (1, 2], the skewness 7 G [—1, 1], the scale parameter Ji > and the shift J G M. 
The quantity $ is given by $ = tan (^-). The scaling with N in eq. ([3D ensures that the 
Hamiltonian ([!)) is of order O(N). Levy distributions contain two different parameters 
that control the bias in the couplings: Jo and 7. We refer the reader to appendix A for 
a discussion of the role of a and 7. For a = 1 and 7 7^ the quantity $ has a different 
expression and we will not consider this case in the sequel. 

The SK model is obtained for a = 2 independent of 7: in this case the distribution 
P^ 1,7,Jo ( J) is Gaussian with mean Jq/N and variance Jf/N pQ. For a < 2 and 
— 1 < 7 < 1, the asymptotic behavior p(J) of P Jl,7,J °(J) for | J| — > 00 can be derived 
from the explicit form of L J ^ a ' J °(q): 

p(J) = N Jim P^(J) = (1 + 7 signJ) (4) 



\J\ 



0+1 



where 



(5) 
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Accordingly, the integrals for the second and higher moments of the distribution diverge 
for a < 2 due to the power- law decay illustrated by eq. (@J. 

We can define stable distributions through (j3J) without losing any generality, see 
for example [20l [2Tj . We remark that there are many equivalent definitions possible for 
the characteristic function L, see [21]. Loosely speaking, a random variable x is stable 
if the sum of a given number of independent and identical copies of x is characterized 
by the same distribution as the original variable, exhibiting only a different scale and 
shift. 



3. The replica method 

3.1. The distribution of effective fields 

In order to study the thermodynamic behavior of the Levy spin glass we employ the 
replica method [3]. The partition function of the system at inverse temperature (3 = T~ x 
is defined by 

Z = Yl ex p[-^(W^=l..Ar)]> (6) 

with H ({a} i=1 N ) given by eq. (CQ). The averaged free-energy per spin / can be written 
as follows 

f = - lim lim — — InZ". (7) 



The symbol (...) denotes the average over the quenched random couplings {Jij} with 
the distribution P^ 1,7 ' Jo (J). The quantity Z n is computed for positive integers n and 
the limit n — > is taken through an analytic continuation to real values. 

However, the integer moments Z n of the partition function diverge for real /3 due 
to the power-law behavior of P^ in,J °{J) for \ J\ — > oo. As noted in reference p2], the 
introduction of an imaginary temperature (3 = —ik, with a real parameter k > 0, 
allows a straightforward calculation of the average Z n by means of the definition of the 
characteristic function, eq. (J3J. However, it is not possible to write the averaged Z n 
in terms of the two standard order-parameters usually employed in the description of 
FC systems, i.e., the magnetization and the spin-glass order parameter. Therefore, it 
is necessary to use the replica method, as developed to deal with FiC spin glasses [22J. 
The macroscopic behavior is characterized in terms of a non-Gaussian effective field 
distribution. This procedure was followed in [T7j. Following their calculations we find 
the equation for the free energy / in the limit N — ► oo: 

f = fi + h, (8) 

with 



ifc/ a = - lim ^- [ ~ (^7=) l°"- r r C 1 + ^7sign(<r • r)$) - tkJ (a.r) 



PMP(r) 
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k h = nSon l ° g {^ eXp l°"- r r (! + ^7sign(o- • t)$) - ik.J 



cr.T] 



P(t) 



The order parameter -P(cr), with er = (cr 1 , a 2 , . . . , a n ), fulfills the self-consistent equation 

(11) 



exp 




—ikJ cr ■ t — 


J\ka-T 


a 

(1 + rysign(cr • r)$) 


) 




E.exp (E T P(r) 


—ikJ cr ■ t — 


J\ka-T 

V2 


a 

(1 + rysign(cr • r)$) 


1) 



We make the replica-symmetric (RS) ansatz, 

exp (—ikha a ) 



Pa) 



dhW(h) \ 



a=l 



2 cosh (—ikha a ) 



(12) 



which defines the field distribution W(h). Substitution of (1T21) in (TTTT) gives: 

<i JdJ 



W(h) = J ^~" ex P («s/i)expj — J 



dhW(h) 



2tt 



A) |J|°(l + i 7 $sign(J))+iJ J 



exp 



The function f(J,h,s) is defined as 



is 



f(J, h, s) = exp ( — — atanh tanh {(3 J) tanh {(3h) 



(13) 



(14) 



The analytic continuation of T to real values has been achieved by taking k = i(3 at the 
end of the calculation. Using eqs. (!B.ip - (lB.5l) from appendix B, we integrate in eq. ({TBI 
over the J variable to obtain the following simplified expression for W(h) 

< a < 1 : 



ds 

W(h) = I — exp <^ ish — isJ m 



dhW(h) / dJp(J) f(J,h,s 



(15) 



1 < a< 2 : 
W(h) = 



ds 
2^ 



exp (^ish — is Jom\ 

xexpi [ dhW(h) I dJp(J) f{J,h,s)-f'(0,h,s)J 



(16) 



df(JAs) 
dJ 



J=0 



. The distribution of couplings p(J) is defined by eq. (j4j). 



where /'(0, /i, s) 

The RS magnetization m and the RS spin-glass order-parameter q are determined 
through the averages 

dhW(h) tanh ((3h), q = [ dhW(h) tanh 2 (f3h). 



m 



(17) 



Only the large tail behavior of the distribution P^^ J ° appears in the equations (fT5"l) 
and (|T6|) . This could mean that the system exhibits a certain degree of universality: 
the thermodynamic behavior only depends on the large tail behavior of the coupling 
distribution P(J). The distribution p(J) is symmetric when 7 = 0, with eqs. (fT5|) and 
(fl6]l reducing to a single equation, obtained previously in [T7] . 



(1 
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3.2. The normalization of the coupling distribution through a cutoff 



The main difficulty in eqs. ( fl5j) and ( fl~6l) concerns the normalization of p(J) since the 
integral J dJp(J) diverges for a < 2. Therefore, it is not possible to normalize the 
distribution. This invalidates the numerical calculation of W(h) through the population 
dynamics algorithm [23] because it is not possible to sample random numbers from a 
non-normalizable distribution. 

In this subsection we propose a simple procedure that allows to normalize p( J) and 
to derive a self-consistent equation for W(h) which is similar to the order-parameter 
equation of FiC spin glasses on random graphs. The numerical solution of this equation 
can be obtained through population dynamics. 

The method consists of the insertion of a temperature dependent cutoff Te > 
in the integrals over J occurring in eqs. ( [15]) and ( 1T61) . splitting each of them into an 
integral around zero (from — Te to Te) plus an integral over the couplings that satisfy 
| J\ > Te. Assuming Te <C 1, the integrals around zero can be analytically performed 
by expanding f(J,h,s) around J = up to order 0(J 2 ), resulting in the following 
equations 

< a < 1 : 



dJp(J) f(J,h,s) - 1 



-2%s^C a tanh (f3h) 



(Te 



a 



s 2 C a tanh 2 ((3h) 



(Te 



,2-a 



2- a 



1 < a < 2 : 



dJp(J) Q(J - Te) + 0(-J - Te) f(J, h,s)-l 

(Te) 2 ~ a 



18) 



dJp(J) f(J, h, s) - f'(0, h, s)J — 1 = -s 2 C a tanh 2 (/3h) 



+ / dJp(J) Q(J -Te) + Q(-J -Te) f(J,h,s) 



2- a 
f'(0,h,s)J 



(19) 



The symbol 0(J) denotes the Heaviside step function: 0(J) = 1 if J > and 0( J) = 
otherwise. We define the normalized distribution P e (J) in terms of p(J) 

a(Te) 



2C a 



-p(J) 0(J -Te) + 0(-J -Te) 



(20) 



Subsituting eqs. ( fT8l) and ( 1191 in, respectively, eqs. ( [T5]) and ( fT6l) the integrals over s 
can be analytically calculated: 



w e (h) = j2^v 



k=0 



v. I (n^(^)) / (n 




X 



S | h — Jom — (5 1 atanh tanh ((3J r ) tanh ((5h r 



r=l 



2qAz 



where T>z = (2n) 2 exp (—z 2 /2)dz and: 



2C a 
a(Te) a) 



(Te) 2 ~ a C a 
2- a 



(21) 



(22) 
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(23) 

To describe the thermodynamic behavior of Levy spin glasses one has to solve the set 
of equations (IT7|) and f[2"Tj) for e — > 0. 

When we compare equation (|2~T]) with the order parameter equations of FiC systems 
|18j . it describes the effective field distribution of a FiC system of Ising spins, in which 
the number of connections per site k follows a Poissonian distribution with connectivity 
c. The values of the k couplings attached to a site are drawn from the distribution 
P e (J), see eq. ( 1201) . In addition, the analytical calculation of the integrals over the 
couplings that satisfy |J| < Te yields an interaction with the global magnetization 
with effective strength Jo an d an extra source of noise in eq. (12T1) . represented by the 
Gaussian random variable z with zero mean and variance A. The effective strength 
contains the shift parameter J and a term linear in 7 corresponding with the center 
of the distribution of the couplings. The interpretation of equation (12"T1) is clear : the 
effective field contains a Poissonian term coming from a finite number of strong bonds 
and a Gaussian term coming from an infinite number of weak bonds it interacts with. 
One can perform the limit a — ► 2 to find the effective field J^m + Jx-^/qz, i.e. the RS 
solution of the SK model. The equations ( fT7l) and ( !2Tj) show explicitly how Levy spin 
glasses are a hybrid between FC and FiC models. When one takes a Gaussian ansatz 
for the distribution W e , equation (12T]) becomes in the limit e — > equal to the result 
derived by Cizeau and Bouchaud [To] . 

The population dynamics algorithm [23] can be easily adapted to solve numerically 
eq. (1211) and obtain W e (h). The idea is to obtain numerical results for sufficiently small 
values of Te in a way that they can be extrapolated for Te — > 0: the first two moments 
of the distribution already obtain their limiting values around Te < 0.5. The equations 
become very hard to solve around a ~ 1.5 because the mean connectivity c has a 
maximum there. For low values of a < 0.1 population dynamics becomes inaccurate 
because of numerical imprecisions due to the larger tails of the coupling distribution. 

In figure [1] we compare the solution of equations (1TT1) and (12T1) with Monte-Carlo 
simulations. We simulated a Levy spin glass using the algorithm described in [17] 
without the parallel tempering. The algorithm contains two update rules: single 
spin flip updates as usually done in Metropolis algorithms and updates of clusters 
of spins connected through strong bonds. For low temperatures we find a good 
agreement between the simulations and the theory. Around the critical temperature 
the magnetization obtained by the simulations is larger than the one predicted by the 
theory. The reason for this difference is that the simulations equilibrate very slowly. 
Indeed, as shown in the inset of figure [1] the magnetization decays as a power law as 
a function of the number of Monte-Carlo sweeps. The presence of strong bonds slows 
down the dynamics since the effect becomes larger for smaller values of a. For very low 
temperatures the simulation results for the magnetization deviate from those of the RS 
result. The RS ansatz (1T21 is invalid for very low temperatures, see section [6) 

In figure [2] we plotted the solution to the self-consistent equation ( 12T1) for different 



J = U) + 2 7 C a 



{Tey- a 



a 
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values of a. The result is compared with the Gaussian ansatz (solid lines), used in |15j . 
The difference between both approaches is clear. For a — > 2 the distribution of fields 
becomes more and more Gaussian. For a < 2 the distribution of fields is not Levy but 
leptokurtic distributions where the moments converge to a finite value as a function 
of the size of the population. Leptokurtic distributions have a smaller kurtosis than a 
Gaussian distribution with the same variance. 



Figure 1. The magnetization to as a function of the temperature T for several values 
of a and Jo. Simulation results (markers) are compared with results from the theory 
(solid lines) for J\ — 1, 7 = 0. At low temperatures theory and simulations are in 
good agreement. Because of the increase in the equilibration time around the critical 
temperature the results from simulation overestimate the magnetization. The inset 
confirms this: it shows the value of the magnetization as a function of the number of 
Monte Carlo sweeps for a — 0.5, Jq = 0.75 and T = 1. 



4. Cavity method 

We derive the self-consistent eqs. ( l2Tj) for W(h) through the cavity method. In contrast 
with [15] we only apply the CLT to the field coming from the weak bonds, i.e. bonds 
smaller than the cutoff Te. The bonds larger than Te form a backbone graph of strong 
bonds which is treated as a FiC system. For e — > 00 we find back the results of [15] . 
For e — > we expect to find the RS behavior of the spin glass. 

The marginal Pi(<Ji) = X^}. N \a t P ( { a j}j=i n) °^ ^ ne Gibbs distribution 




T 




can be written as 




(24) 
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Figure 2. The distribution of effective fields with Jo — 7 = 0, Ji = f, T = 0.4 
and several values of a. The markers give the distributions according to equation (|2ip 
while the solid lines are obtained through the theory of [15]. All the moments of the 
distributions are finite. Therefore we have leptokurtic distributions which arc neither 
Gaussian nor Levy distributions. 



with pW ^{{jj}j =1 N \ a^j the Gibbs distribution on the cavity graph G®. The cavity 
graph is the subgraph of the original graph G where one removed the i-ih spin and all 
of its interactions with the other spins. We assume that the probability distribution on 
the cavity graph factorizes [3]: 

^ w ({^-w\^) = n p /w (25) 

i(#) 

This factorization is valid when there is one pure phase in the system. The set uJ^ of 
all weak bonds and the set of all strong bonds are defined through: 

oJ w = {j'GNn [1, N]\Jij < Te} , (26) 

= (Nfl [1,N]) \cJ (i) . (27) 

The cavity fields and are defined through: 

h f = £f log(^V))tfje<A (28) 

fff ^Eflog^V))*^ - (29) 

cr 

The marginal of the z-th spin on the cavity graph is equal to: 

Pi i \°i)~ II ^exp^ter + ^fr) J] ^ exp (/5J^r + ^r) . (30) 

We used the notation /i^ for cavity fields where one removed a site j connected with 
i through a strong bond and the notation gf^ for fields where the site j was connected 
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with % through a weak bond . We thus find the following set of closed equations in the 
cavity fields nf 1 and gf . 

g® = z\ j) + /T 1 J2 atallh ( tanh (P* 1 ®) tanh 9 J ki)) » ( 31 ) 

h { f = Zi + /T 1 atanh ( tanh (fi^k) tanh (P J ki)) , (32) 

keui\j 

where we defined a third field containing the contributions from the weak bonds 



/T 1 ^ atanh (tanh (figf^j tanh (/3J W )) . (33) 

keui\j 

In the limit N — > oo we can remove the j dependency in the fields z^ and g^' because 
the sum over the weak bonds (k G Ul) contains an infinite number of terms. 

To take the disorder average over the couplings we define the following distributions: 



W w (g) = ytJ , (34) 





- 9i) 


N 


y N y 


S (h - hif) 




y 




Zi) 


N 



W s (h) ee -^ r — * L (35) 



W s (z) = «> . (36) 

We treat the ^-fields as a sum of infinitely many random variables on which we can 
apply the CLT: 

W g (z) = -l=e W (- {Z 'i° m)2 ), (37) 
gV ' y^E^ F \ AAq r K J 



with A and Jo as defined in eqs. f[22|) and f[23|) . The parameters m and q determine, 
respectively, the mean and the variance of the Gaussian distribution W s (z). Here is the 
important difference with [15] where the CLT is applied on all bonds, also on the strong 
ones. 

From eq. (133]) one finds, for N — > oo and e < 1 the following expressions for the 
mean m and the variance q 

m= (jVf 1 (n J ^ dJP^> J °(J)jj J dgtaDh{j3g)W w {g), (38) 



q = (2A)" 1 (nJ* dJP^ J °(J)A J dg tanh 2 ((3g)W w (g). 



(39) 



The integrals over the couplings in eqs. ( 1381) and ( 139]) can be calculated using analogous 
methods as used to derive the integrals in appendix B: 

r Te 

N dJP^ Ja (J)J = Jo, (40) 

J-Te 

N j dJP^' Jo (J)J 2 = 2A. (41) 

J —Te 
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Using the definitions of the distributions W w (g) and W s (h) in eqs. (13~4"j) and (l3l)|) we get 

OO / 7 \ 7 ^ — 1 /« /* k~~ 1 « 

fc=0 C r=l ^ ^ r=l ^ 



5 ^/t - 2 - /T 1 atanh (tanh(/3/i r ) tanh(/3J r )) J , (42) 

OO n k n k n 

w w (g) = ^Ppoiss(fc;c) / ]Jdh r w s (h r ) / J]rfJ r P e (J r ) / dzw g (z) 

k=0 J r=l J r=l J 

5 (g - z - /T 1 atanh (tanh(/3/i r ) tanh(/3 J r )) J . (43) 



=i 



The mean connectivity c is given by 

H E£ik (,) (<OI = r°° dJ (J) /" Te rfJ ( n = _^«_ (44) 

with p(J) the large tail behavior as defined in (J4]). We use the following property of 
Poissonian distributions: ~p po iss(&; c)k = p poiss (k-l; c) to find W w (g) = W s (g) = W e (g), 
i.e. the solutions to f|42l) and f|4"3l) are the same as the solution W t of fl2~il . Indeed, 
eqs. P31 combined with fl38|) and fl39|) are identical to eqs. ffTTj) and fl2il derived with 
the replica method. From the cavity approach the importance of the CLT in Levy 
spin glasses becomes clear: the couplings have a divergent variance, therefore one can 
not apply the CLT as done in [15]. We remark that the effective coupling Jo and the 
parameter 2A appearing in the replica method are the mean and the variance of the 
weak couplings. The distribution W e {h) in equations ( l2~TT) is the distribution of the 
cavity fields propagating along the backbone graph of strong bonds. 



5. Stability of the replica symmetric ansatz 

As is known [21], the RS ansatz introduced in ( fT2|) is unstable at low temperatures. It 
is possible to calculate the regions of stability by using the two replica method, first 
introduced for FiC models in |25j. This method allows us to study local and non-local 
replica symmetry breaking (RSB) effects. For models on graphs a relevant instability 
condition is proved rigorously in [26] . It determines the region where the message passing 
algorithms stop to converge, see for example the discussion in |27j . 

We start by considering two uncoupled replicas. Both replicas fulfill the equations 
(I30l)-(l33l). The replicas only get coupled when we take the average over the graph 
instance. Indeed, the effective field distribution of two sets of uncoupled spins on the 
same graph with the same couplings is given by: 

OO / 7 \ 7 ^ _ /* n k~ 1 r, 

We {h\h 2 ) = Y J P -^^ 1 \{ / dhldh 2 r W e (hlhl) / ]JdJ r P € (J r ) / dz l dz 2 W g {z\z 2 ) 

k=0 ° r=l J r=l J 

x 5 ^h 1 - z 1 - /T 1 ^2 atanh (tanh(/9/iJ) tanh(/3J r )) \ 
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fc-i 



5 lh 2 - z 2 - p' 1 ^ atanh (tanh(/?/i 2 ) tanh(/3 J r )) . (45) 



r=l 



We assume again that we can apply the CLT on the z-fields: 



WJzKz 2 ] 



1 / 1 (z 1 - Jom 1 ) 2 (z 2 - J m 2 ) 2 

: exp 1 



4Avr v /g 1 g 2 (l-p 2 ) \ 2(1 - p 2 ) ^ 2A^ 2Ag 2 

(p(z 1 - Jom 1 )^ 2 - J m 2 )\ 
x exp — — — - . (46) 

V 2(l-p 2 )AvW J 
The order parameters become 

m l = J dg 1 dg 2 tevk{Pg 1 )W e {g\ g 2 ), (47) 

q 1 = J ^WtanhW^QAs 2 ), (48) 

m 2 = J dg^gHanhtfg^W^g 2 ), (49) 

q 2 = J ^rf/tanh 2 ^ 2 )^^ 1 ,/), (50) 

PvW= j ^ 1 ^ 2 tanh(^ 2 )tanh(^ 1 )W e (^ 1 ,/). (51) 

In the limit a — > 2 we find W^h 1 ,^) = W g {h}, h 2 ). An expansion around the RS 
solution m 1 = m 2 = m, q 1 = q 2 = q and 1 — |p| ~ 0(5), with i5 < 1, leads to the 
following stability condition: 
r+°° du { u 2 \ 

fi~ 2 = / —j= exp I — - sech 4 [fisfqu + (3J m) . (52) 

The parameters (q, m) in fl52|) are, respectively, the overlap parameter and the 
magnetization of the SK model. Equation (152]) is precisely the AT line of the SK 
model, see [24] . 



6. Phase Diagram 

The system shows three phases which depend on the values of the order parameters m 
and q defined in (1171) : a paramagnetic phase (P) with m = q = 0, a ferromagnetic phase 
(F) with m > 0, q > and a spin-glass phase (SG) with m = 0, q > 0. The ferromagnetic 
phase contains a region stable to RSB effects (-F stable ) and a region unstable to RSB 

effects (instable)- 

The P-F and P-SG transitions are determined using an expansion of the self- 
consistent eq. (|2ip around the paramagnetic solution W e (h) = 5(h). For 7 = we 
find the same bifurcation lines as derived in [17]. To determine the SG-F transition and 
the -F unstab ie to -F stable transition one has to solve numerically, respectively, eqs. ( |2~TT) and 
( l4"5l) with for instance a population dynamics algorithm. 
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Figure 3. The (TV Ji, Jo/Ji) phase diagram for several values of a and with a skewncss 
7 = 0. Three phases appear: P (paramagnetic), F (ferromagnetic) and SG (spin glass). 
The circles present the SG-F transitions and the stars indicate where the F phase 
becomes stable against replica symmetry breaking. For a = 2 the phase diagram 
coincides with that of the SK model. 




Figure 4. The (T/Ji, a) phase diagrams for different values of the skewness 7 and a 
shift Jo = 0. The figure on the left gives the phase diagram for 7 > while the figure 
on the right gives the phase diagram for 7 < 0. For 7=1 and a < 1 there is no SG 
phase. The P — SG transition is independent of 7. For 7 = 0.99 the dashed part of 
the transition line does not present the SG-F transition but the instability line of the 
P phase with respect to the F phase. 



In figure [3] the different phases in the (Jq/Ji, T/Ji) phase diagram are presented 
for a skewness 7 = and several values of a. The open circles present the SG-F 
transitions and the stars mark the points where the F phase becomes stable with respect 
to RSB. These results generalize the phase diagram obtained in the seminal paper of 
Sherrington and Kirkpatrick [1] to coupling distributions with a large tail. For 7 = 
the P-F transition is independent of a. When a increases the SG phase increases in 
favor of a smaller F phase. The RSB effects decrease when a decreases: indeed the 
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-^unstable becomes smaller and the reentrance effect in the SG-F phase transition line 
diminishes and finally disappears. This is related to the decrease of frustration due to 
the presence of stronger bonds that dominate the systems behavior. We did not find a 
replica symmetric SG phase (i.e., a SG phase stable with respect to RSB), contrary to 
the conjecture made in |15j . Replica symmetry breaks continuously at the SG transition 
similar to the behavior of the SK model. We did not find any further evidence for the 
conjecture in [15] that replica symmetry restores at T = 0. 

In figure H] we present the (T/Ji, a)-phase diagram for different values of 7 and 
Jq = 0. We consider the following regions: 

• 7 > and a < 1 (left figure): the F phase increases and the SG phase decreases as 
a function of increasing 7. The SG phase disappears at 7 = 1. For values of 7 very 
close to one the SG phase is only present for very small values of a. The transition 
temperature between the P and F phase becomes infinite for a — > 1~. 

• 7 < and a > 1 (right figure): the F phase decreases and the SG phase increases 
as a function of increasing 7. The transition temperature between the P and F 
phase becomes infinite for a — > 1 + . 

• 7 > and a > 1 (not shown): there is no F phase but a P and SG phase. 

• 7 < and a < 1 (not shown): there is no F phase but a P and SG phase. 

We have some additional remarks: The transition temperature becomes very large for 
a — > l^ (for, respectively, 7 < and 7 > 0) because the effective coupling J — > 00. 
There is no SG phase for 7 = 1 and a < 1 because there are no negative couplings, 
only the P-F transition occurs. The P-SG transitions coincide for different values of 7. 
For low values of a the results of population dynamics become inaccurate because of 
numerical imprecisions when dealing with a broad range of coupling values. In this case 
we used the instability line of the P phase with respect to the F phase as of the location 
of the SG-F transition. 

7. Entropy 

It is possible to calculate the free energy from the saddle point equations. We use the RS 
ansatz and we introduce again a cutoff e. The entropy is given by s = /3 2 ^ = lim e ^o s(e) 
with s(e): 



,2 A(1 



q) + s S ite(e) - o-Slink(e)- 



(53) 



The quantity si in k is equal to 




(54) 
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and s site reads 

s s ite(e) = -J2^rU[ dh i W M / dJ iWi)} / V* 

k=0 1=1 J J 

^ exp ((PJ m + ^/2qAz)a) [J* =1 (exp (PJ e r e a) exp (Ph e Te)) 

CT; ( Tl , T2i ..., Tfc) E^Cn.-ra.-.Tk) ex P ((/^om + \/2gA^W Fti ( ex P (P J i T t<r) exp (/3/i<r<)) 



log 



exp ((/3J m + y^gA^a) nLi ( ex P {PJt T t<?) exp (f3h e T e )) 



(55) 



_E<7;( n ,r 2 ,-,r fc ) ex P ((/^o™ + VSgA^cr) J] <= i (exp {pJtTio) exp (ph e r e )) 

For a — > 2 one gets precisely the entropy of the SK model [2] . The entropies s S i te and sunk 
correspond with the entropy differences when performing, respectively, a site addition 
and a link addition on the backbone graph of strong bonds, see [T9l [23] . Similar to the 
form of the self-consistent equation (|2ip for W e (h) we find that the entropy as given by 
equation (|53|) corresponds to the entropy of an Ising model on a Poissonian graph with 
mean connectivity c, a distribution of the bonds P e and an extra Gaussian noise z. 

We plotted the entropy s as a function of a in figure [5] From this figure we see 
that the entropy gets less negative, for T — > 0. We find that for smaller values of a < 1 
the entropy becomes eventually zero for T — > 0. This is consistent with a decrease of 
RSB effects when a decreases. 
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Figure 5. The entropy s as a function of the exponent a for different values of the 
temperature T, Jo = 0, 7 = and J\ = 1. The filled markers at a = 2 show the SK 
values. The entropy converges to the SK value for a — ► 2. 



8. Conclusion 



In this paper we have shown how to derive the phase diagrams of Levy spin glasses 
where the couplings between the spins are drawn from a distribution with power law 
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tails characterized by an exponent a. These models are known to have a finite number 
of strong bonds of order 0(1) and an infinite amount of weak bonds of order (9(A r_1//Q ). 
The crucial difference with previous works [15] and [TT] is that we derive the phase 
diagrams, the entropy and the stability against replica symmetry of Levy spin glasses 
without using the Gaussian assumption for the distribution of fields. We have neither 
found evidence for a replica symmetric spin-glass phase, nor for a restoration of the 
replica symmetry at zero temperature, contrary to the conjecture in |T5|. We have 
solved the problem using the replica and the cavity method within, respectively, the 
replica symmetric assumption and the assumption of one pure phase. The resultant 
effective equations for the distribution of cavity fields show clearly the hybrid character 
of the model being a mixture between a finite connectivity model and a fully connected 
model. 

The phase transitions are qualitatively similar to the ones found in the SK model. 
Large tails do influence quantitatively the phase diagram: the Levy spin-glass model 
becomes more stable with respect to replica symmetry breaking and the SG phase 
decreases when the tails get larger. Moreover, the reentrance effects in the replica 
symmetric phase diagram disappear for a < 1. The replica symmetry breaking 
transitions are all continuous. The skewness 7 in the Levy distribution can have a 
big influence on the size of the F phase. For a — > 2 the effective distribution of fields 
becomes Gaussian and we have found back the results of the SK model. For a < 2 this 
distribution is neither Levy nor Gaussian, but a distribution with finite moments and a 
kurtosis smaller than a Gaussian with the same variance. 

Acknowledgments 

One of the authors (F. L. Metz) acknowledges a fellowship from CNPq (Conselho 
Nacional de Desenvolvimento Cientifico e Tecnologico) , Brazil. 

Appendix A. Stable distributions 

The purpose of this appendix is to give some intuition on the role of the parameters a 
and 7 present in stable distributions, defined through eqs. ([2]) and ([3]). Both a and 7 
are responsible for the shape of the distribution. The main role of the exponent a is to 
control the decay of the tails. Figure [ATI shows that, for a fixed 7, a decrease in a gives 
rise to a distribution P^ 1,1,Jo iJ) with larger tails and more sharply peaked around its 
most probable value J. The center of P Jl,7,J °(J) is also shifted from the negative to the 
positive J-axis as a decreases from a > 1 to a < 1. A change of a has no effect on the 
position of the center when 7 = 0. 

The skewness parameter 7 controls the relative weight between the positive and 
negative tails. For 7 > 0, the positive tail of P^ in,Jo iJ) is larger than the negative 
one; for 7 < vica versa. The distribution is symmetric around Jo when 7 = 0. For 
increasing positive values of 7, see figure |A~T| the center of P^ ia ' J °iJ) shifts to the right 



The phase diagram of Levy spin glasses 



17 




Figure Al. The Levy distributions P^ in ' J °(J) for J% = 1, J = and different 
values of a and 7. The distributions with a — 1.5 approach a Gaussian while the 
ones for a = 0.5 have larger tails. For 7 > 0, the center of the distribution goes 
to +00 or — 00 for a | 1 or a [ 1, respectively. The coupling distribution fulfills 

pJi,7,Jo(J) = pJi,-T^o(_J). 



or left provided a < 1 or a > 1, respectively. 



Appendix B. Solution of integrals 

In this appendix we show how to integrate over J in the following equations: 

dJdJ , 



h 



2tt 

dJdJ 
2tt 



|J|V JJ /(J), 
|jrsign(J)e Jj /(J), 



(B.l) 



(B.2) 



where /(J) is given by eq. (fill) and a € (0, 1) U (1, 2]. We obtained the following results 
for Ji and -Z2 after integration over J 



V2 
Ji 



dJ 



\J\ a+l 



f(J)-f(o) 



if < a < 2, 



(B.3) 



\/2\ 

V2V 



0+1 



sign(J)/(J),if < a < 1, 



a+l 



sign(J) /(J)-/'( )J 



if 1 < a < 2, 



(B.4) 



(B.5) 



where the parameters C Q and $ are defined in section [2J We have left out the dependence 
of f{J) with respect to h and s since it is not important here. The aim of this appendix 
is to show how one can derive eqs. (1B.3|) . (1B.4P and (1B.5[) from eqs. (IB.ip and (IB. 21) . 
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By introducing an exponential convergence factor in eqs. (IB.ip and ()B.2j) . we can 
rewrite them as follows 

dJ 



Ii = lim 



I2 = i lim 



dJ 

o 

dJ 



f(J) + f(-J) 

f(j)-n-j) 



7T 

00 dJ 
71 



J a cos(JJ)e- aJ , 
J a sin (JJ)e- aJ . 



(B.6) 
(B.7) 



The integrals over J are calculated for a > and, afterwards, the limit a — > is 
performed. Reference [28J can be used in order to integrate over J in eqs. (IB.6j) and 
f)B.7j) . giving rise to 

r -, cos (a + l)arctan(-) 

!(J) + f(-J) - 



h = n^±i) Um 



7T 



. r(a + i) r 

I 2 = 1 lim 

a->0+ 



7T 



f(J)-fi-J) 



sm 



(J 2 + a 2 )^ 
(a + l)arctan(- N 



(J 2 + a 2 )^ 



, (B.8) 
, (B.9) 



In order to analyze the behavior of integrals flB.8j) and (IB. 9|) around J = when a — > 
we insert a cutoff A > and split them as follows 



cos 



7T 

T(a + r 



7T 



7T 



J^+i L 



7T 



T(a + 1) . 
£^2 (A) +t— -sm 



7T 





/•°° dJ r 


_(« + !) 2. 


7a </ q+1 ^ 





where 



f/i(A) = lim 



?7 2 (A) = lim 

a^0+ 



7 a+l 



f(J) + f(~J) 



f(J)-f(-J) 



COS 



f(J)+f(-J) 
f(J) - f(-J) 

[a + l)arctan(-) 



sm 



(a + l)arctan( 



(B.10) 
(B.H) 

(B.12) 

(B.13) 



The limit a — > + has been performed on the right hand side of eqs. (IB.lOj) and fIB.llj) . 
The integrals present in the definition of Z7i(A) and ^(A) are computed through a 
power-series representation of their integrands, yielding the results 

'\\ 2l+a+l 



t/i(A) = lim V" Uni (- 

n,l=0 

00 

U 2 (X) = lim V v nl (-) 



A 



2n— « 



,\\ 2Z+a+2 



A 



2n+l-Q 



(B.14) 
(B.15) 



n,«=0 



The explicit forms of the coefficients {u n {\ and {i>„z} are irrelevant. The analysis of 
eqs. (IB.lOj) and (IB. Ill) as A tends to zero, constrained to the limit a — > + in the 
functions U\(X) and {/2(A), constitutes the final step of the calculation. 

One can notice from eq. (1B.14I) that U\{X) diverges for A — > + . However, the 
transformation of f(J) according to f(J) — > f(J) — /(0) removes this divergence and 
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makes Ui(X) go to zero for A — > + , provided that a < 2. This allows us to perform the 
limit A — > + in eq. (IB.lOj) which leads, after comparison with eq. (IB. II) . to the following 
result 



dJdJ , 
2vr 



I J 



a^iJJ 



3 dJ 



Via 



7l 



1) /an\ 



ja+l 



f(J) + f(-J)-2f(0) 



0<a<2. 



(B.16) 



By integrating the term with /(0) on the left hand side of the above equation we get 
eq. (JR3]). 

The calculation of eqs. (IB. 4ft and (1B.5|) proceeds in an analogous way. Depending on 
the value of a, there are two different situations concerning the behavior of eq. (IB. 151) 
for A — > + . For a < 1, we obtain lim.x^o+ ^(A) = 0, which allows to perform the 
limit A — > + in eq. (jBTTjl . For a > 1, it is necessary to transform /(J) according to 
/(J) — > /(J) — f'(0)J in order to obtain lim A ^ + ^(A) = and to perform the limit 
A -> 0+ in eq. (1ETI1) . 
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